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San Jose has integrated a college readiness indicator system into its strategic plan with the goal of ensuring 
that all its graduates leave the district prepared to fully participate in a global society. 


The author would like to recognize the 
efforts of the San Jose Unified School 
District CRIS Team, whose three years of 
hard work on the CRIS project is reflected 
in this article. 

I n 2012-2013, leaders and staff of the 
San Jose Unified School District 
(SJUSD) focused on accomplishing 
the district’s new mission: to aggressively 
pursue solutions to close the opportunity 
gap and ensure that all students leave 
SJUSD with twenty-first-century skills, 
prepared to participate in a global 
society. The district’s participation in the 
College Readiness Indicator Systems 
(CRIS) initiative 1 presented an opportu¬ 
nity to place the CRIS work within the 
context of the district’s 2012-2017 
strategic plan, Opportunity21. The 


district positioned the CRIS work as a 
way to establish, validate, and model a 
process for broad implementation of 
the district’s Key Performance Mea¬ 
sures (KPMs) - a set of connected data 
metrics that signal how well the district 
is accomplishing its goals (see the 
sidebar for a list of KPMs). 2 


1 CRIS is a partnership between the 
Annenberg Institute for School Reform at 
Brown University, the John W. Gardner 
Center for Youth and Their Communities 
at Stanford University, and the University 
of Chicago Consortium for Chicago 
School Research, with funding from the 
Bill &c Melinda Gates Foundation. See 
the inside front cover and the introductory 
article to this issue by Jacob Mishook for 
more information. 

2 See www.sjusd.org/opportunity21/key- 
performance-measures for more 
information. 
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This positioning of CRIS has ensured 
a coherent K-iz effort by our three 
CRIS schools - Lowell Elementary, 
Hoover Middle, and Lincoln High, 
which together create a college 
readiness pipeline throughout one 
feeder cluster of schools - and created 
a model for districtwide rollout of 
college and career readiness indica¬ 
tors. 3 CRIS teams working on 
indicators at the school and district 
(setting and systems) levels 4 success¬ 
fully implemented what we refer to as 
data intervention cycles, which use 
data to identify struggling students, 
match the students with supports, and 
then evaluate the effectiveness of the 
supports. The district has used these 
cycles to begin building a culture of 
evidence-based practices districtwide. 


SAN JOSE UNIFIED SCHOOL DISTRICT 
AT A GLANCE, 2012-2013 

Superintendent Vincent Matthews 


Number of schools 

52 

Student enrollment 

33,184 

Free/reduced-price lunch 

49% 

English language learners 

23% 

Special education 

10% 

Hispanic students 

52% 

African American students 

3% 

Asian students 

13% 

White students 

26% 

Source: San Jose Unified School District 


3 For more on the SJUSD college readiness 
pipeline at Lowell, Hoover, and Lincoln, 
see Hewitson, Martinez, and McGinnis, 
“The K—1 2. College Readiness Pipeline in 
San Jose: Three Principals’ Perspectives,” 
in Voices in Urban Education no. 3 5 
(Fall 2011), the first issue of VUE on the 
CRIS project, online at http://vue. 
annenberginstitute.org/issues/35/k-12- 
college-readiness. 

4 See Borsato, Nagaoka, and Foley in this 
issue of VUE for a detailed discussion of 
how CRIS indicators work at the student, 
school, and system levels. 


CRIS AS A DISTRICTWIDE 
MODEL OF EVIDENCE-BASED 
PRACTICE AND DATA INTER¬ 
VENTION CYCLES 

SJUSD’s strategic planning process in 
2012-2013 included reflecting on past 
practice and on what the district has 
done well, looking around the country 
at models of effective practice, and 
building an ambitious but achievable 
plan to deliver on these strategic frame¬ 
works. 

SAN JOSE UNIFIED SCHOOL 
DISTRICT KEY PERFORMANCE 
MEASURES 

1. Early literacy (Pre-K - 2nd Grade) 

2. Advanced reading achievement 
(3rd - 8th Grade) 

3. Advanced mathematics achievement 
(3rd - 8th Grade) 

4. English Learner (EL) reclassification 
within six years 

5. Socio-emotional learning scale 

6. Writing performance assessment 

(3 or higher at Grade 2, 4 or higher 
at Grades 6) 

7. Algebra I, B or better (8th grade) 

8. AP (3 or better), IB (4 or better) 

9. SAT (1650+), ACT (24+) 

10. UC/CSU A-G course completion, 

C or better 

11. Exhibiting 21st-century skills 

For many years, SJUSD has met with 
instructional and programmatic success 
and is often referenced for showing 
innovative leadership, particularly in 
the areas of data use at the school level 
and in setting standards for students. 
For instance, SJUSD students will 
graduate having taken the courses 
necessary for entry to University of 
California and California State 
University systems (A-G standards). 5 
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However, gaps in achievement continue 
to exist, particularly for San Jose’s 
Hispanic students. As the district 
worked toward closing the opportunity 
gaps among our students, there were 
several strategies that the organization 
leveraged to help propel work forward. 
While all of the elements of the strate¬ 
gic plan are important, there are a vital 
few that will help to jumpstart the 
efforts to accomplish our new mission. 
CRIS work, specifically, supported the 
district’s commitment to data-driven 
decision making. Our plan was to build 
on existing, good systems to reinforce 
behaviors that channel more resources 
and support to our students in most 
need. These include targeted academic 
programs, curricula, and interventions 
before, after, and during school for 
students who are struggling with core 
subjects and literacy; individualized 
adult support for students with behav¬ 
ioral and socio-emotional difficulties; 
and college advising in the areas of 
navigating the application and financial 
aid process for college-eligible students 
who might otherwise not receive 
support in overcoming these barriers to 
college entry and enrollment. This was 
driven primarily by the publication of 
our Key Performance Measures 
(KPMs), which both guided the 
organization and held it accountable 
for results. The CRIS program was 
critical to allowing us to validate our 
measures and to pilot systems of action 
based on these indicators. 


5 The A-G curriculum is a series of college 
preparatory courses that high school 
students must take to be eligible to enter 
the University of California and California 
State University systems. See etools.berkeley. 
edu/resources.php?cat_id=22 for more 
information. 


During 2010 to 2012, the SJUSD CRIS 
team put in place these key evidence- 
based structures, practices, and 
processes: 

• created a CRIS District Team, 
thereby ensuring system-level 
supports for college readiness 
focus and work; 

• created school-level teams at the 
feeder pattern schools Towell 
Elementary, Hoover Middle, and 
Tincoln High, to implement data 
intervention cycles that support 
student success at the setting level; 

• conducted ongoing retreats to share 
out best practices; 

• established biweekly meetings of the 
District CRIS team and each site 
team; and 

• shared our work with other partner 
districts in the CRIS network. 

BUILDING A CULTURE OF 
EVIDENCE USE THROUGH CRIS 
SITE TEAMS 

The CRIS site teams used data 
intervention cycles, which involved 
using data to: 

• identify a struggling group of 
students, using indicators in three 
dimensions of college readiness: 
academic preparedness, academic 
tenacity, and college knowledge 

(see the article by Borsato, Nagaoka, 
and Foley in this issue of VUE); 

• design interventions to support these 
students and improve their success; 

• evaluate the effectiveness of the 
interventions; and 

• scale them out to the rest of the 
school. 

These cycles and the CRIS school 
teams have become a model of evi¬ 
dence-based practice that the district 
subsequently planned to scale out in 
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2012-2013 and beyond through 
cross-functional groups called (OP- 
STAT) teams 6 that represent different 
departments, roles (principals, teach¬ 
ers, counselors, district administrators), 
and levels (elementary, middle, and 
high), and engage in deep inquiry 
around one of the eleven KPMs. In the 
2012-2013 school year, SJUSD 
launched three OPSTAT teams that 
focused on increased AP/IB participa¬ 
tion and performance, socio-emotional 
learning, and graduation rates and 
completion of A-G requirements. 

Three to four additional OPSTAT 
teams per year will tackle other KPMs 
in the coming school years, starting 
with early literacy in 2013-2014. 

During year one of work (2012-2013 
for the first wave of teams), OPSTAT 
teams engaged in intense and focused 
data analysis to identify the thresholds 
to be used in developing different tiers 


The district will forge ahead with efforts to 
map out supports and interventions and 
track these consistently through emerging 
data system capabilities. 


of supports for students. The teams 
also examined and selected the most 
effective strategies to improve student 
success on the particular KPM. The 
teams published reports and/or shared 


6 “OPSTAT (‘OP’ for Opportunity 21 and 
‘STAT’ for statistics and its data-driven 
nature) is a process whereby teams 
composed of both site and central office 
staff create replicable practices to improve 
student outcomes” (from www.sjusd.org/ 
schools/documentation/downloads/Data_ 
Research_Eval_Handbook.pdf). 


findings with the rationale behind the 
KPM and its significance, data exam¬ 
ined, evidence-based processed 
implemented, recommended interven¬ 
tions, and implementation and 
monitoring processes for school sites 
to put these supports to action. 

In 2013-2014 and beyond, school-level 
teams that are CRIS-like will continue 
the work of each KPM’s OPSTAT team 
at their sites, to ensure roll-out and 
sustainability of the evidence-based 
practices and beliefs. SJUSD is building 
out a district accountability system 
based on reports that track schools’ 
KPM progress. Reports will be auto¬ 
mated and sent out on alerts through 
the new Data Warehouse and Business 
Intelligence Tool to which the district is 
transitioning in 2013-2014. KPM 
reports will be customized for different 
levels within the organization, includ¬ 
ing senior leadership, site leadership, 
and teachers. Site and district OPSTAT 
teams will use these reports, with 
support from the district office, to 
monitor the success of interventions at 
the setting and system levels. 

School data teams, modeled on CRIS 
and OPSTAT teams, will conduct 
annual inquiry cycles in accordance 
with the following projected timeline: 

• research and investigate thresholds 
for struggling students: first and 
second quarter of the school year; 

• identify and plan for effective 
interventions and supports for 
struggling students: third quarter; and 

• implement interventions and 
supports: fourth quarter and 
summer. 

Throughout this process, the teams will 
consistently communicate their work 
to other site staff to elicit buy-in and 
build capacity for implementation of 
the selected strategies. 
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ONGOING INDICATOR 
DEVELOPMENT AND 
IMPLEMENTATION 

The district CRIS team and the three 
CRIS schools continued refining 
indicators of academic preparedness, 
academic tenacity, and college knowl¬ 
edge at the individual and setting levels. 
Teams continued to meet on a regular 
basis to assess progress, share challeng¬ 
es, and make mid-course corrections 
based on implementation feedback and 
evidence. Retreats took place at the 
beginning of each school year for the 
school and district CRIS teams to share 
indicator development and data 
collection results for each chosen 
indicator and to cement lessons learned 
for K-i2 expansion of CRIS work. 

SJUSD also made advances in the 
selection of indicators and the imple¬ 
mentation of a CRIS at the elementary 
and middle school levels, with the goal 
of informing and influencing a K-12 
trajectory of college readiness begin¬ 
ning with the early grades. SJUSD 
partnered with the Everyone Graduates 
Center at Johns Hopkins University. 
This partnership, through direct 
collaboration around the socio-emo- 
tional learning OPSTAT team, helped 
us to identify when off-track indicators 
emerged in the academic tenacity 
trajectory of our students at the 
elementary and middle school levels 
and what interventions from grade to 
grade could be most effective to bring 
students back on track. Our Hoover 
Middle School CRIS team, in particu¬ 
lar, has been implementing a 
micro-process intervention strategy 
since August 2011. 


LOOKING AHEAD 

We are confident that SJUSD will 
continue making advances on the most 
persistent challenges to developing and 
scaling a CRIS. The district will take 
advantage of a new user-friendly data 
warehouse and reporting tools to 
position CRIS work and its offshoots 
(like OPSTAT) so as to increase data 
capture of online learning technologies 
related to college readiness in the years 
to come. SJUSD will continue to scale 
out CRIS work and processes across 
school sites and the central office 
through OPSTAT district and site teams. 

Efforts are also in place to validate our 
high schools’ selection of indicators 
and how they map to indicators at the 
elementary and middle school levels, as 
well as to explore the development of 
predictive models around the CRIS 
work. We will also forge ahead with 
efforts to map out supports and 
interventions and track these consis¬ 
tently through emerging data system 
capabilities. The district is poised to 
leverage the success and lessons learned 
from CRIS efforts to date in order to 
create a scalable framework that will 
guide overall KPM efforts in data 
collection and reporting; data-based 
decision-making (use of data and 
goal-setting based on measures’ cut 
points); implementation strategies for 
interventions and supports based on 
the data analysis; and the extension of 
CRIS work to other sites in conjunc¬ 
tion with the roll-out of KPMs. 
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